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Abstract. Surface parameterizations and registrations are important in computer graphics and 
imaging, where 1-1 correspondences between meshes are computed. In practice, surface maps are 
usually represented and stored as 3D coordinates each vertex is mapped to, which often requires lots 
of storage memory. This causes inconvenience in data transmission and data storage. To tackle this 
problem, we propose an effective algorithm for compressing surface homeomorphisms using Fourier 
approximation of the Beltrami representation. The Beltrami representation is a complex-valued 
function defined on triangular faces of the surface mesh with supreme norm strictly less than 1. Under 
suitable normalization, there is a 1-1 correspondence between the set of surface homeomorphisms and 
the set of Beltrami representations. Hence, every bijective surface map is associated with a unique 
Beltrami representation. Conversely, given a Beltrami representation, the corresponding bijective 
surface map can be exactly reconstructed using the Linear Beltrami Solver introduced in this paper. 
Using the Beltrami representation, the surface homeomorphism can be easily compressed by Fourier 
approximation, without distorting the bijectivity of the map. The storage memory can be effectively 
reduced, which is useful for many practical problems in computer graphics and imaging. In this paper, 
we proposed to apply the algorithm to texture map compression and video compression. With our 
proposed algorithm, the storage requirement for the texture properties of a textured surface can be 
significantly reduced. Our algorithm can further be applied to compressing motion vector fields for 
video compression, which effectively improve the compression ratio. 
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pression, video compression, motion vector compression 

1. Introduction. Surface registration and parameterization are important pro- 
cesses in computer graphics and imaging, where 1-1 correspondences between meshes 
are computed. For example, in video compression, registrations between image frames 
are necessary to capture the deformation of objects in images PQEJE]. While in com- 
puter graphics, surface parameterizations are needed for texture mapping [4[[5j[6]. 
There are many different approaches for surface registration and parameterization. A 
commonly used method is to find surface maps satisfying certain constraints, such as 
matching landmarks [jj [I6j [TTl [18] and minimizing distortions [lOj [TTJ [12] [14] . Sur- 
face maps computed from these processes can be highly convoluted and are usually 
represented and stored as 3D coordinate functions in R 3 . A huge storage memory is 
therefore required, especially when a large set of fine surface meshes are to be pro- 
cessed. For instance, in computer graphics, mesh parameterization that maps each 
vertex of the surface to a 2D position on an image is required for texture mapping. In 
order to have a high-quality textured mesh, mesh parameterizations of high-resolution 
are necessary. Usually, a great amount of memory and bandwidth are needed to store 
and transmit the data of the surface map, which causes a great deal of inconvenience. 
Nevertheless, very little work has been done on the compression of bijective surface 
maps. This motivates us to look for a compression scheme for surface homeomor- 
phisms, which can significantly reduces the storage requirement. 

In this work, we propose an effective algorithm for compressing surface homeomor- 
phism using the Beltrami representation. The Beltrami representation is a complex- 
valued function defined on triangular faces of the surface mesh with supreme norm 
strictly less than 1. It measures the local conformality distortion of the surface map. 
Every surface map is associated with a unique Beltrami representation. According 
to the Quasi-conformal Teichmuller theory, under suitable normalization, there is an 
1-1 correspondence between the set of surface homeomorphisms and the set of Bel- 



2 



Lok Ming Lui et al. 



trami representations. In other words, every surface map can be represented by a 
unique Beltrami representation. Conversely, given a Beltrami representation, one can 
reconstruct the unique surface map associated to it. In this paper, we propose an 
algorithm called the Linear Beltrami Solver to reconstruct the surface map associated 
to a given Beltrami representation. Using the Beltrami representation, 1/3 of the re- 
quired storage space for a bijective surface map is saved. Furthermore, the Beltrami 
representation has very little constraints. The only constraint is that its supreme 
norm has to be strictly less than 1. It does not have any requirements of inject ivity 
nor surjectivity. This allows us to further compress the Beltrami representation using 
Fourier approximations, without distorting the bijectivity of the map. The storage 
memory can then be significantly reduced. However, Fourier compression is not possi- 
ble for other representations such as 3D coordinate functions, as the bijective property 



(1-1 and onto) of the resulting maps cannot be guaranteed (see Figure 4.2 , Figure 4.3 
and Figure [44]). 

Our proposed algorithm for surface map compression can be practically applied 
to problems in computer graphics and imaging. In this paper, we propose to apply 
the algorithm to texture map compression and video compression. With our proposed 
algorithm, the storage requirement for the texture properties of a textured surface can 
be significantly reduced. Our algorithm can further be applied to compressing motion 
vector fields for video compression, which effectively improve the compression ratio. 

In short, the contribution of this paper is three- folded: 1. we propose a compres- 
sion algorithm for surface homeomorphism using the Fourier approximation of the 
Beltrami representation; 2. we propose the Linear Beltrami Solver to exactly recon- 
struct a surface map from its associated Beltrami representation; and 3. we apply 
the proposed algorithm to texture map compression and video compression, which 
significantly reduces the storage requirement. 

This paper is laid out as follow. In Section 2, we describe the relevant works 
closely related to this paper. In Section 3, we describe some basic mathematical con- 
cepts related to our algorithms. In Section 4, we describe in detail the main algorithm 
we use to compress bijective surface maps with their Beltrami representations. We 
also describe how surface maps can be efficiently and accurately reconstructed. Appli- 
cations of the proposed algorithm to texture map compression and video compression 
are described in Section 5. In Section 6, a conclusion is drawn. 

2. Related works. In this section, we give an overview of the previous works 
mostly related to our paper. 

Surface parameterization/registration. Surface parameterization and regis- 
tration have been extensively studied, for which different representations of bijective 
surface maps have been proposed. Conformal registration, which minimizes angular 
distortion, have been widely used to obtain a smooth 1-1 correspondence between 
surfaces [H EH [I2j El [141 [Til El] • For example, Hurdal et al. [14 proposed to compute 
the conformal parameterizations using circle packing and applied it to registration of 
human brains. Gu et al. [TQl HH [11] proposed to compute the conformal parameteri- 
zations of human brain surfaces for registration using harmonic energy minimization 
and holomorphic 1-forms. Conformal registration is advantageous to local geometry 
preservation. But it cannot match feature landmarks, such as sulcal landmarks on 
the human brains, consistently. To alleviate this issue, Wang et al. [151 [18] proposed 
to compute the optimized conformal parameterizations of brain surfaces by minimiz- 
ing a compounded energy. All of the above algorithms represent surface maps with 
their 3D coordinate functions. Special attention is required to ensure the bijectivity 
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of the resulting registration. Besides, smooth vector field has also been proposed to 
represent surface maps. Lui et al. [17] proposed the use of vector fields to represent 
surface maps and reconstruct them through integral flow equations. They obtained 
shape-based landmark matching harmonic maps by looking for the best vector fields 
minimizing a shape energy. The use of vector fields to represent surface maps makes 
optimization easier, but they cannot describe all surface maps. Time dependent vec- 
tor fields can be used to represent the set of all surface maps. For example, Joshi et al. 
[T3] proposed the generation of large deformation diffeomorphisms for landmark point 
matching, where the registrations are generated as solutions to the transport equa- 
tion of time dependent vector fields. The time dependent vector fields facilitate the 
optimization procedure, although they may not be a good representation of surface 
maps since they requires more storage memory. 

Texture mapping. The technique of texture mapping has been extensively em- 
ployed on rendering 3D graphics in animation and video gaming. The basic idea of 
it is to map an image onto a given surface so as to increase the realism of the 3D 
model [23j [24] . The problem of finding a suitable parameterization for texturing a 
polygonal mesh has been widely studied [26] [27]. Besides, the storage memory for 
texture properties contribute a significant portion of the total file size of a textured 
mesh. Texture mapping compression is therefore necessary. Recently, much attention 
has been focused on compressing texture images while preserving the quality of the 
textured 3D model. Balmelli et al. [25 warped the texture and sub-sampled it to 
reduce the unnecessary image space. Yoon et al. [41] proposed a wavelet-based image 
compression technique which is specialised for compressing texture properties of a 
polygonal mesh. Iourcha et al. [37] proposed the S3TC texture compression method, 
which is the most common texture compression algorithm nowadays. S3TC is a lossy 
compression algorithm that adapts a block truncation coding. Recently, researches 
has also been carried out on the high dynamic range (HDR) texture compression, 
which encodes texture images at a constant 8 bits per pixel [55]. Furthermore, to 
overcome the bandwidth problem in 3D rendering, mesh compression algorithms, 
which reduce the storage memory for mesh geometry and mesh connectivity, have 
been proposed [35 , 36 . However, compression of texture coordinates has received less 
attention. Isenburg et al. [56 proposed an algorithm in which texture cooridnates are 
predicted from mesh vertices through parallelogram rule. However, such algorithm 
only reduces half of the storage requirement and depends greatly on the similarities 
between meshes and the texture map. 

Video compression. Video compression has developed rapidly over last decades. 
Many techniques and algorithms for video compression have been proposed [42] 04] 
[43] . The basic idea to achieve the compression is to remove temporal and spatial 
redundancies existing in video sequences. The first generation of video compres- 
sion involved techniques for intra- frame coding and simple inter- frame coding [47] . 
Motion-compensated predictive coding was later proposed, which has been exploited 
in all recent video coding standards such as MPEG-2, MPEG-4 or H.264 [48l H2l 143] . 
The major component in motion compensated coding is the motion vector (MV) 
estimation. Various techniques for motion vector estimation have been proposed 
[50j [49j [54j [STJ [52] [53]. In this paper, we are interested in compressing the motion 
vectors using their Beltrami representations which can further improve the compres- 
sion ratio of existing video compression algorithms. 

Surface map compression. Compression of mappings has also been studied. 
Chai et al. [30] proposed the depth map compression algorithm by encoding mappings 
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as a simplified triangular meshes. Lewis [33] described a technique for compressing 
surface potential mapping data using transform techniques. All these methods deal 
with the compression of real- valued functions defined on 2D domains. For vector- 
valued functions, Stachera et al. [34 developed an algorithm to compress normal 
maps by decomposing them in the frequency domain. Ioup [31] also proposed to com- 
press vector map data in the frequency domain. Kolesnikov et al. [32 proposed an 
algorithm for distortion-constrained compression of vector maps, based on optimal 
polygonal approximations and dynamic quantizations of vector data. All these meth- 
ods do not deal with preserving bijective maps between surfaces. The bijectivity (1-1, 
onto) of the maps can be easily lost due to lossy compression. 

Compression of surface registrations that preserves the bijectivity was prelimi- 
nary studied by Lui et al. [19]. In that work, Beltrami coefficient (BC) defined on 
every vertex of the mesh was proposed to represent bijective surface maps. BC can 
approximate the associated surface map well only when the triangulation is regular. 
Also, Beltrami Holomorphic Flow (BHF) was used to iteratively reconstruct surface 
maps from their BCs. Integration has to be computed in each iteration, which causes 
inefficiency in many practical applications. BHF was further applied for the opti- 
mization of surface registration in [20]. In this paper, we propose to use Beltrami 
representation defined on each triangular faces to represent bijective surface maps. 
The Beltrami representation can exactly represent the surface map, regardless of the 
regularity of the triangulation. Also, Linear Beltrami Solver is proposed to efficiently 
reconstruct surface map from its Beltrami representation. 

3. Mathematical Background. In this section, we describe some basic math- 
ematical concepts related to our algorithms. For details, we refer the readers to 

A surface S with a conformal structure is called a Riemann surface. Given two 
Riemann surfaces M and A 7 ", a map / : M — >• N is conformal if it preserves the 
surface metric up to a multiplicative factor called the conformal factor. An immediate 
consequence is that every conformal map preserves angles. With the angle-preserving 
property, a conformal map effectively preserves the local geometry of the surface 
structure. 

A generalization of conformal maps is the quasi- conformal maps, which are orien- 
tation preserving homeomorphisms between Riemann surfaces with bounded confor- 
mality distortion, in the sense that their first order approximations takes small circles 
to small ellipses of bounded eccentricity [8]. Thus, a conformal homeomorphism that 
maps a small circle to a small circle can also be regarded as quasi-conformal. Sur- 
face registrations and parameterizations can be considered as quasi-conformal maps. 
Mathematically, /: C — >• C is quasi-conformal provided that it satisfies the Beltrami 
equation: 

for some complex valued Lebesgue measurable \i satisfying ||/i||oo < 1- I 1 is called the 
Beltrami coefficient, which is a measure of non-conformality. In particular, the map / 
is conformal around a small neighborhood of p when /x(p) = 0. Infinitesimally, around 
a point p, f may be expressed with respect to its local parameter as follows: 

f(z)=f(p)+f z (p)z + Mp)z 

= f(p) + Mp)(z + n(p)z). [ -> 
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arg(//)/2 



Fig. 3.1. Illustration of how the Beltrami coefficient measures the conformality distortion of a 
quasi- conf or mal map. 



Obviously, / is not conformal if and only if ja(p) ^ 0. Inside the local parameter 
domain, / may be considered as a map composed of a translation to f(p) together 
with a stretch map S(z) = z + fi(p)z, which is postcomposed by a multiplication of 
fz(p), which is conformal. All the conformal distortion of S(z) is caused by 
S(z) is the map that causes / to map a small circle to a small ellipse. From 
we can determine the angles of the directions of maximal magnification and shrinking 
and the amount of them as well. Specifically, the angle of maximal magnification is 
arg(/z(p))/2 with magnifying factor 1 + The angle of maximal shrinking is the 

orthogonal angle (arg(/x(p)) — 7r)/2 with shrinking factor 1 — The distortion or 

dilation is given by: 

K=(l + \fi(p)\)/(l-Mp)\). (3.3) 
Thus, the Beltrami coefficient \i gives us all the information about the properties 



of the map (See Figure 3.1). 



Given a Beltrami coefficient fi : C — »• C with ||/i||oo < 1- There is always a 
quasiconformal mapping from C onto itself which satisfies the Beltrami equation in 
the distribution sense [8]. More precisely, 

Theorem 3.1 (Measurable Riemann Mapping Theorem). Suppose \i : C —> C is 
Lebesgue measurable satisfying ||/x||oo < 1; then there is a quasiconformal homeomor- 
phism (j) from C onto itself, which is in the Sobolev space W 1,2 (C) and satisfies the 
Beltrami equation \S.l\ in the distribution sense. Furthermore, by fixing 0, 1 and oo, 
the associated quasiconformal homeomorphism (j) is uniquely determined. 

By reflection, the above theorem can be further extended to Beltrami coefficients 
defined on the unit disk D. 

Theorem 3.2. Suppose \i : D — >• C is Lebesgue measurable satisfying ||/x||oo < 1, 
then there is a quasiconformal homeomorphism (j) from the unit disk to itself, which is 
in the Sobolev space W 1,2 (ft) and satisfies the Beltrami equation 3.1 in the distribution 



sense. Furthermore, by fixing and 1, the associated quasiconformal homeomorphism 
(j) is uniquely determined. 



Theorem |3 . 1 1 and Theorem ^2 suggest that under suitable normalization, a home- 
omorphism from C or D onto itself can be uniquely determined by its associated Bel- 
trami coefficient. These two theorems can be extended to homeomorphisms between 
Riemann surfaces 120 . 
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Fig. 3.2. Reconstruction of a bijective map from its Beltrami coefficient. (A) shows the original 
bijective map between the unit square. (B) shows the reconstructed map from its Beltrami coefficient. 
(C) shows the colormap of the norm of the Beltrami coefficient. 



Let Si and 62 be two genus-0 closed surfaces with a 3-point correspondence 
between them: {pi,P2?P3 £ $1} O {Q11Q21Q3 £ ^2}- By Riemann mapping the- 
orem, Si and S2 can both be uniquely parameterized by 0i : Si — » S 2 = C and 
02 : S2 —> S 2 = C respectively, such that <fii(pi) = 0, 0i(p2) = l,0i(p3) = 00 and 
02 (#1) = 0? 02(^2) = 1? 02(^3) = oo- Given any surface diffeomorphism /: Si — )> S2, 
the composition map / := 02 / 07^_: § 2 — »• S 2 is a diffeomorphism from 8 2 to 



itself fixing 0, 1 and 00. By Theorem 3.1, / can be uniquely represented by a Bel- 
trami coefficient Jl defined on 8 2 . Hence, / can be uniquely represented by a Beltrami 
coefficient ji := Jl o 0^ 1 defined on Si. In other words, we have the following: 



Theorem 3.3. Let Si and S2 be two genus-0 closed surfaces. Suppose f: Si — >• 
S2 is a surface diffeomorphism. Given 3-point correspondence {pi,P2 5 P3 G Si} ^ 
{f(Pi):f(P2):f(Ps) £ ^2}; / can 6e represented by a unique Beltrami coefficient ft : 
Si C. 

Similarly, let Mi and M2 be two genus-0 open surfaces. Given 2-points cor- 
respondence {pi G Mi,p2 ^ 9Mi} O {qi G M2,<72 £ 9M2} between them, we 
can again uniquely parameterize Mi and M2 to map the corresponding points to 
O^and 1. Denote them by 0i : Mi — >• B and 02: M2 — » B. The compositionjnap 
/ := 02 o / o cj)^ 1 : B — >• B is a diffeomorphism of B fixing and 1. Again, / can 
be uniquely represented by a Beltrami coefficient Jl defined on B. Hence, / can be 
uniquely represented by a Beltrami coefficient ji := Jl o 0^ 1 defined on M\. So, we 
have the following theorem: 

Theorem 3.4. Let Mi and M 2 be two genus open surfaces with disk topology. 
Suppose f: Mi — > M 2 is a surface diffeomorphism. Given 2-point correspondence 
{pi G Mi,p 2 £ dMi} o {/(pi) £ M 2 ,/(p2) £ <9M 2 } ; / can 6e represented by a 
unique Beltrami coefficient \i\ Mi C. 

Theorem |3.3| and |3.4| allow us to represent a homeomorphism of genus-0 closed 
surfaces or open surfaces with disk topology using a Beltrami coefficient. The Bel- 
trami coefficient unqiuely determine the surface map with least constraint. Using the 
Beltrami coefficient, we can easily compress the surface maps. These two theorems 
play important roles for the main algorithms proposed in this paper. 

4. Main Algorithms. In this section, we describe in detail the main algorithms 
proposed in this paper to represent and compress surface homeomorphisms using the 
Beltrami representation. We also describe how the quasi-conformal homeomorphism 
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Fig. 3.3. Reconstruction of surface homeomorphism from its Beltrami representation. (A) 
shows the original surface homeomorphism between two genus-0 closed surfaces. (B) shows the 
reconstructed surface map from its Beltrami representation. The reconstructed map closely resemble 
to the original one. (C) shows the colormap of the norm of the Beltrami representation. 



can be reconstructed from its associated Beltrami representation using the proposed 
Linear Beltrami Solver. 

4.1. Beltrami representation for bijective maps between meshes. Sur- 
face registration and parameterization are commonly represented by 3D coordinate 
functions. This representation requires lots of storage space and is difficult to ma- 
nipulate. For example, the 3D coordinate functions have to satisfy certain constraint 
on the Jacobian J (namely, J > 0) in order to preserve the 1-1 correspondence of 
the surface maps. Enforcing this constraint adds extra difficulty in manipulating or 
compressing surface maps. It is therefore important to have a simpler representation 
with as few constraints as possible. 



Theorem |3.3| and |3.4| tell us that we can represent diffeomorphisms of smooth 
Riemann surfaces using Beltrami coefficients. In practice, surfaces are represented 
discretely by triangular meshes. Surface maps are usually approximated by piecewise 
linear homeomorphisms between meshes. Our goal is to represent piecewise linear 
maps between meshes by a simple and easy-to-manipulate representation. 

Suppose K\ and K 2 are two surface meshes with the same topology (either genus- 
closed surface mesh or simply-connected open surface mesh). Define the set of 
vertices on K\ and K 2 by V 1 = {vj}f =1 and V 2 = {vf}f =1 respectively. Similarly, 
define the set of triangular faces on K x and K 2 by F 1 = {T}}f =1 and F 2 = {Tf}f =1 
respectively. Now, consider a piecewise linear homeomorphism / : K\ — >• K 2 between 
K\ and K 2l which is orientation preserving. In other words, f\ T i is piecewise linear 
and orientation preserving. We aim to represent / by a complex-valued function 
defined on each triangular face of K\. 

We first parameterize K\ and K 2 . Suppose K\ is a simply-connected open surface 
mesh. K\ and K 2 can be parameterized onto a unit square R = [0, 1] x [0, 1] by 
harmonic maps: : K\ —> R and (j) 2 : K 2 — >• R respectively (See Figure [4J^ A)). The 
harmonic parameterizations <pi (i = 1,2) can be computed by solving a sparse linear 
system [57] : 

^ k u ,v((/>i{u) - <t>%{v)) = with 
[u,v]eKi (4.1) 

0i(po) = (0,0); &( Pl ) = (0,1); &(p 2 ) = (1,0); ^(p 3 ) = (M); 

where Po,Pi,P2 and ps are four fixed vertices on the boundary. Other boundary 
vertices are constrained to be uniformly distributed on the boundary of the unit 
square R. The weight k uv is given by the cotangent formula: k uv = cot a uv + cot P uv 
where a uv and j3 uv are the two adjacent angles of the edge [u,v\. 
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(A) Simply-connected open surfaces (B) Genus-0 closed surfaces 



Fig. 4.1. Illustration of how Beltrami representations for homeomorphisms between meshes can 
be computed. (A) shows the case of a homeomorphism between simply- connected open meshes. The 
two meshes are mapped to a unit square by harmonic parameterizations . (B) shows the case of a 
homeomorphism between genus-0 closed surface meshes. The two meshes are parameterized onto a 
triangle in R 2 ; after cutting away a triangular face on each mesh. 



In case K\ is a genus-0 closed surface mesh, the surface mesh can be para meter ized 
onto a big triangle on R 2 by cutting away one triangular face (See Figure 4.1 'B)). 
The harmonic parameterizations & (i = 1,2) from Ki to a triangle on 
computed as follows: 



can be 



^ k u ,v((t>i(u) - 4>i{v)) = with 
[uM^ % (4.2) 

M V l)=Pl: <M^2)=P2, M V s)=P3 

where T % = [v^v^vl] corresponds to the cut away triangular face on K{ and {^1,^2,^3} 
are three fixed point on R 2 . 

The bijective map / : K\ — » K2 can now be represented by the Beltrami coefficient 
\ij of the composition map / : <j>2 o / o cf)^ 1 : D — >• D, where D is a triangular mesh in 



R 2 . D is either the unit square or a triangle in the complex plane (See Figure 4.1). 
To compute /ij, we simply need to approximate the partial derivatives at each 

face T. We denote them by D x f(T) and D y f(T) respectively. Note that / is piecewise 
linear. The restriction of / on each triangular face T can be written as: 

f\(^y)=( aTX l b / y T T ) (4.3) 

J 1 v \ c T x + d T y + q T J v ; 

Hence, D x f(T) = ar + icr and D y f(T) = br + idx- Now, the gradient Vt/ : = 
[D x f{T),D y f{T)) t on each face T can be computed by solving: 

v 1 -vq\ ~_( fi(vi) - fi(vo) \ (AA , 



where [^0,^1] and [vq, V2] are two edges on T. By solving equation 4.4 , ay, ct and 
dr can be obtained. The Beltrami coefficient fJLf(T) of the triangular face T can then 
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be computed from the Beltrami equation |3.1| by: 



[i ~(T) = ( fl r-d T ) + >/ z T(cr + &r) ^ 

The Beltrami coefficient \ij defined on each triangular face of D uniquely deter- 
mine the surface map /. Hence, the complex- valued function [if := [ij o <pi defined 
on each face of K\ uniquely determine the surface map / : K\ — » K2. We call [if 
the Beltrami representation of /. Given a Beltrami representation, the corresponding 
surface homeomorphism can be exactly computed, which will be described in the next 



subsection (See Figure 3.2 and 3.3). 



In summary, the Beltrami representation of a homeomorphism between surface 
meshes can be computed as follows. 

Algorithm 4.1 : (Computation of Beltrami representation) 

Input : Surface meshes: K\ and K2; piecewise linear homeomorphism: f : K\ — >• K2; 
a fixed triangular face T if K\ is genus- or 4 fixed points on dK\ if K\ is a topological 
disk. 

Output : Beltrami representation: [if 

1. Get harmonic parameterizations : K\ —> D and <p2 ' K2 —> D by solving 
the linear system \4^l\ or \4.£\ 

2. Compute the gradient of f := 4*2 / 4*! 1 '• D — >• D for each triangular face 
of D by solving the linear system \4-4\ 

3. Compute the Beltrami coefficient of f for each triangular face of D by equation 

M 

4. Compute the Beltrami representation [if of f by computing [if := [ijo^. 

4.2. Linear Beltrami solver. Given a Beltrami representation, it is important 
to have an algorithm to reconstruct the associated quasi-conformal homeomorphism. 

Suppose Ki and K 2 are two surface meshes with the same topology (either topo- 
logical disks or genus-0 closed surface meshes). Given a Beltrami representation /i, 
which is a complex- valued function defined on each triangular face of K\, our goal is 
to reconstruct the associated homeomorphism / : K\ — >• K2 between K\ and K%. 

We first compute the harmonic parameterizations : K\ —> D and <j)2 • K2 



D using equation 4.1 or 4.2 We shall look for a piecewise linear homeomorphism 
/ : D — > D with Beltrami coefficient [ij := <p\ 0/1. The desired homeomorphism / 

can then be reconstructed by taking the composition: / = 02 o / o Again, the 
restriction of / on each triangular face T is linear and thus it can be written as: 



Let [i(T) = pT + V^T tt- Equation 4.5 gives 



n , rr (q T - d T ) + a/-T(c t + b T ) , , 

Pt + V-It t = - — — ^— — (4.7) 

[a T + d T ) + y— l(c T - br) 



This is equivalent to 



-dr = ol^clt + ci^br 

Ct = C*2 CLT + OL^bT 



(4.£ 
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2r T rv T _ l+2p T +p T +r T 



wnere. a x - 1 _ p |_ r 2 , a 2 - i- p 2_ r 2 , a 
Similarly, one can deduce that 



<1t = ci^ct + ajdx 



Let T = [vijVj, Vfe] and wi = f(vi) where I = i, j o r fc. Suppose i>j = ^rj + T ^/ 



and iuj = si + v^T £/ (/ = z,j, fc). Using equation 4.4, a,T,bT,CT and can be 
written as follows: 

a T = Af Si + ^ + Als k ; b T = Bj Si + Sfs, + 

(4.10) 

c T = Aju + Ajtj + Ajfo; d T = Bf U + Bjtj + Bj^; 

where: 

Af = (hj - h k )/2Area(T), Aj = (h k - hi)/2Area(T), Al = (hi - hj)/2Area(T); 

Bj = (g k ~ gj )/2Area(T), Bj = (g t - g k )/2Area(T), B? = ( 9j - g t )/2Area(T); 

(4.11) 

For each vertex Vi, let Ni be the collection of neighborhood faces attached to Vi. 
By careful checking, one can observe that 

A[b T Area(T) = ^ B? a T Area(T); ^ Ajd T Area(T) = ^ B?c T Area(T). 

TeNi TeNi TeNi TeNi 

(4.12) 

Thus, following from equation |4.8| and [49l we have 

( A I Wi a T + «2 H + B Ii a 2 a T + o%br]) Area(T) = (4.13) 

TeNi 



(Aj[aJc T + al d T ] + Bj\a\c T + afd T ]) Area(T) = (4.14) 

for all vertices Vi E D. Note that ax and 6t can be written as a linear com binati on of 
the x-coordinates of the desired quasi-conformal map /. Hence, equation 4.13 gives 
us the linear systems to solve for the x-coordinate function of /. Similarly, ct and 
dj 1 can also be written as a linear combina tion of the y-coordinates of the desired 



quasi-conformal map /. Therefore, equation |4. 14| gives us the linear systems to solve 
for the y-coordinate function of /. 

Besides, / has to satisfy certain constraints on the boundary. When K\ is a 
genus-0 closed surface mesh, the parameter domain D is a triangle with boundary 
vertices po? Pi and In this case, the desired quasi-conformal map / should satisfy 

f(Po) = Po', f(pi) = Pi and f(p 2 ) = p 2 (4.15) 

When Ki is a topological disk, the parameter domain D is unit square. In this 
case, the desired quasi-conformal map should satisfy 

/(O) = 0; /(l) = 1 f(i) = i /(l + i) = 1 + z; 
Re(/) = on arc [0,i]; Re(/) = 1 on arc [1, 1 + i}; (4.16) 
Imag(/) = on arc [0, 1]; Imag(/) = 1 on arc [i, 1 + i] 
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Table 4.1 

Comparison of the computational time and error under LBS and BHF. 





IHloo 


Ll-error (LBS) 


Time (LBS) 


Ll-error (BHF) 


Time (BHF) 


Map 1 


0.6258 


1.365 x 10- 14 


0.032 s 


0.0064 


98.5 s 


Map 2 


0.8556 


9.326 x 10- 15 


0.028 s 


0.0159 


96.4 s 


Map 3 


0.9995 


2.408 x 10~ 13 


0.033 s 


0.0313 


102.2 s 



Equations |4. 13| and |4. 14| together with the above boundary conditions give a non- 
singular linear system to solve for /. The linear system is symmetric positive definite. 
Hence, it can be solved effectively by the conjugate gradient method. Once / is 
computed, the desired quasi-conformal map between K\ and can be computed by 
taking the composition: / = (j)^ 1 o / o 

We summarize the reconstruction scheme of the quasi-conformal map from its 
Beltrami representation as follows. 

Algorithm 4.2 : (Linear Beltrami Solver) 

Input : Surface meshes: K\ and K^; Beltrami representation \i 
Output : Quasi-conformal map f : K\ — >• K2 associated to \i 

1. Get harmonic parameterizations : K\ —> D and <p2 ' K 2 —> D by solving 



the linear system \4^\ or \4-2\ 

2. Compute the Beltrami coefficient [ij := p^ 1 

3. Compute the quasi-conformal map f : D — >> D associated to fij by solving the 



linear system^A^ and \4-14\ boundary conditions \4-15\ or \4-16\ 



4. Compute the quasi-conformal map f : K\ — >• K2 by f = (j) 2 1 o / o <j) 1 

In some situation, the surface mesh may be parameterized onto an arbitrary do- 
main Q in R 2 (such as in texture mapping applications). In this case, the Beltrami 
representation together with the boundary map uniquely determines the parametriza- 
tion. By solving Equation 4. 13| and |4. 14| together with the boundary condition given 



by the boundary map, the parameterization can be exactly reconstructed. 

Experimental results show that the proposed Linear Beltrami Solver can effec- 
tively compute the surface homeomorphism associated to a given Beltrami represen- 
tation. Compared to the Beltrami Holomorphic Flow (BHF) method introduced in 
[I9j |20] , our method can compute the associated surface homeomorphism more ac- 
curately and efficiently. Table |4.1| shows the comparison of the computational time 
and error under the LBS method and the BHF method. Experimental results show 
that LBS method can compute the associated surface map much faster than the BHF 



method. Also, the accuracy is much better when using LBS. As shown in Table 4.1 
the numerical error under LBS is much less than that under BHF. The computa- 
tional efficiency of LBS allows us to apply our proposed algorithm in more practical 
applications that require real-time processing, such as video compression. 



4.3. Compression of surface homeomorphisms. The Beltrami representa- 
tion can be further compressed using the Fourier approximation to reduce the storage 
requirement. An important consideration is to preserve the bijectivity of the recon- 
structed surface map after the compression. 

Under the representation by coordinate functions, the surface map cannot be 
easily compressed using the Fourier approximation without distorting the bijectivity. 
In order to preserve the bijectivity, the Jacobian of the coordinate functions has to be 
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Fig. 4.2. Compression of bijective map. (A) shows the original bijective map of the unit 
square. (B) shows the reconstructed map from the compressed Beltrami representation. The recon- 
structed map closely resembles to the original map in (A). (C) shows the reconstructed map from 
the compressed coordinate functions. The bijectivity of the map is completely disrupted. 



greater than 0. This constraint is equivalent to an inequality in the partial derivatives 
of the coordinate functions. Enforcing this constraint is difficult during compression 



and the bijective property is easily lost (see Figure 4.2, 4.3 and 4.4). The Beltrami 
representation, however, is advantageous because it does not have any requirement 
for injectivity and surjectivity, making the Jacobian constraint unnecessary. The only 
requirement for the Beltrami representation \i is that it has to be a complex- valued 
function defined on the triangular faces with supreme norm less than 1. We can 
therefore compress \i using Fourier approximations without losing the bijectivity. 

Let K\ be a simply-connected open surface mesh. Suppose \i is the Beltrami 
representation of the surface map / : K\ — >• if 2- We first parameterize K\ to the unit 
square D by the parameterization : K i —> D. We can then obtain the Beltrami 
coefficient \ij := p^ 1 , which is defined on triangular faces of D. Let D reg be the 

N x N regular finite difference grid of the unit square. Here, N = y/Nf, where Nf is 
the number of triangular faces of K\. We linearly interpolate fij defined on D onto 
D reg to obtain a Beltrami coefficient \±~ 9 defined on D reg . 
l/~ g can be expressed by Fourier expansion as follow: 

N-l N-l 

H{x,y) =J2J2 Cj^^^^e 2 ^ 1 ^^, (4.17) 

j=0 k=0 



where 



iV-lJV-l 



x=0 y=0 



-2v^lirky/N 



We can use fast Fourier transform to compute the coefficients Cj^ efficiently. 
One can then take fewer Fourier coefficients to approximate the Beltrami coefficient, 
which can significantly reduce the storage requirement. With the Fourier coefficients 
of the truncated Fourier series, the compressed Beltrami coefficient defined on D and 
hence the compressed Beltrami representation \i c defined on K\ can be obtained. 
/i c accurately approximates /i, and hence the quasi-conformal map associated to fi c 
closely resembles to /. 

In summary, the Fourier compression scheme can be described as follows: 
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Fig. 4.3. Compression of bijective map with different compression ratios. The top row shows the 
reconstructed map from the compressed Beltrami representation with different compression ratios. 
The bottom row shows the reconstructed map from the compressed coordinate functions with the 
same compression ratios as in the top row. 



Algorithm 4.3 : (Compression of Beltrami representation) 
Input : Beltrami representation \i and compression percentage e 
Output : e% Fourier coefficients Cj y k 's 

1. Get harmonic parameterization <pi : K\ —> D by solving the linear system^ 

2. Compute the Beltrami coefficient fij := <pi o /i 

3. Compute \i~ g defined on the regular grid D reg by linear interpolation 



117 



4. Compute the Fourier coefficients of f/- 9 using equation 

5. Store e% Fourier coefficients c^h 's 

Experimental results show that the proposed compression algorithm is stable and 



effective in reducing the storage requirement of bijective surface maps. Figure 4.2 A) 
shows a homeomorphism from a regular grid. (B) shows the reconstructed home- 
omorphism from the compressed Beltrami representation. The reconstructed map 
closely resembles to the original one. (C) shows the reconstructed map from the com- 
pressed coordinate functions. Note that the bijectivity is completely disrupted. In 
comparison, Beltrami compression gives accurate results with just a small number of 



coefficients. Figure 4.3 shows the result of Beltrami compression with different com- 
pression ratios. The reconstructed maps again closely resemble to the original data. 
In the bottom row of Figure [431 we show the reconstructed map from the compressed 
coordinate functions with the same compression ratios. Again, the bijectivity of the 
reconstructed maps is completely disrupted. 

The proposed compression scheme can also be applied to compressing surface 



homeomorphisms. Figure 4.4 A) shows the original surface homeomorphism between 
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Fig. 4.4. Compression of bijective surface homeomorphism between two genus-0 closed surfaces. 
(A) shows the original surface homeomorphism between two closed surfaces. (B) shows the recon- 
structed surface map from the compressed Beltrami representation. (C) shows the the reconstructed 
surface map from the compressed coordinate functions. 



two genus-0 closed surfaces. (B) shows the reconstructed surface map from the com- 
pressed Beltrami representation, which closely resemble to the original map in (A). 
(C) shows the the reconstructed surface map from the compressed coordinate func- 
tions. It is observed again that the bijectivity of the surface map cannot be preserved 
after the compression. 



5. Applications. In this section, we apply our proposed compression algorithm 
to texture map and video compression. A flow chart summarizing the idea of the two 



applications is shown in Figure 5.1 



5.1. Compression of Texture Mapping. Texture mapping techniques have 
been extensively studied to provide realistic 3D rendering in movies, animation and 
video gaming. The basic idea of texture mapping is to map a texture image onto 
a given surface, so as to increase the realism of the 3D model. As the demand for 
higher level of realism is rising, texture mapping of higher resolution is also required 
for producing more detailed models, which in turn increases the required storage 
capacity and transmission bandwidth for texture coordinates. The need for a compact 
representation of the texture mapping is therefore crucial. In this section, we propose 
to develop an effective algorithm for texture map compression using the Beltrami 
representation. 

Mathematically, a texture map is a parameterization of a surface onto a 2D 
image. This parameterization is commonly represented by its coordinate functions 
P — (pi, P2), which maps each vertex of the mesh to a 2D position, given by 

p : M -> [0,1] x [0,1] (5.1) 

where M is the surface mesh. Conventionally, the target range is set to be [0, 1] x [0, 1], 
which can be obtained by normalizing the texture image. In other words, a texture 
mapping can be considered as a piecewise linear homeomorphism between the surface 
mesh M and a 2D mesh in [0, 1] x [0, 1] . Once every vertices are assigned to a 2D 
position, the texture image can be mapped onto the 3D surface mesh. 



Figure |5.2| illustrates the idea of texture mapping. The left shows a 2D texture 
image. Vertices a, b and c have texture coordinates p(a),p(b) and p(c) respectively. 
With this per- vertex assignment, texels can be assigned to the interior of the triangle 
by linear interpolation. In real application, a 3D model is usually represented by fine 
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Surface homeomorphism 

1. Texture mapping 
(Section5.1) 

2 . Video mo tio u vecto r field 
(Section 5.2) 



> 



Computation of 

Beltrami 
representation 
(Algorithm 4,1) 



Fourier compression 
(Algorithm 43) 



Encoding part 



Reconstructed surface 
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Solver (Algorithm 4.2) 



Inverse Fast Fourier 
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Dec Odin: 



g part J 



Fig. 5.1. Summary of the steps of encoding and decoding of texture mapping/video compression. 



meshes composed of many small triangular faces. With the texture mapping, texels 
can be mapped to the interior of each triangular faces, and hence the whole textured 
surface mesh can be obtained. 

Texture images are not necessarily of regular shapes. In order to minimize the 
distortion of the texture mapping, surface meshes are often partitioned into patches 
and parameterized onto texture images with irregular shapes. Figure |5.3| shows a 
typical example of texture mapping. (A) shows the surface mesh of a zebra, which 
is partitioned into patches. Each patch is parameterized onto a texture image with 
irregular shapes, as shown in (B) and (C). In other words, the surface mesh consists 
of several texture mappings corresponding to different patches. With the texture 
mappings, texture images can be mapped onto the surface mesh. (D) shows the 
textured surface mesh of the zebra. 

In practice, a textured surface mesh is commonly represented by its mesh geom- 
etry, mesh connectivity, texture mapping and texture image. Usually, the storage 
memories for texture properties contribute a significant portion of the total file size 
of the textured mesh. This motivates us to look for an effective compression scheme 
for texture mapping. 

Here, we propose an effective algorithm for texture mapping compression by the 
Beltrami representation of the texture coordinates. Consider a surface mesh M with 
texture mappings {pi : Mi — » [0, 1] x [0, l]}£=i, where M^s are patches of M. Our goal 
is to compress the texture mappings /Vs. We first parameterize Mi onto a unit square 
D b y harmonic parameterizations fa : Mi — >• D. It can be done by solving Equation 
The Beltrami coefficient pi of pi := pocj)' 1 can then be computed. As described in 



4.1 



Section 4.1, the Beltrami representation pi := PiO(\>i together with the boundary map 
Pi\dMi uniquely determine pi. Using the Fourier compression scheme as described in 
Algorithm 4.2, the Beltrami representation pi can be effectively compressed. Hence, 
the texture mapping pi can now be represented by 1) the Fourier coefficients c l - k in 
the truncated Fourier series, and 2) the texture coordinates of all boundary vertices 
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a = (x 1 ,y v z 1 ) 




b = (x 2> y 2) z 2 ) 



c = (x 3 ,y 3 ,z 3 ) 



Fig. 5.2. Illustration of a typical texture mapping in a triangular mesh. Vertices a,b and c are 
mapped to p(a),p(b) and p(c) respectively. Texels in the interior of the triangle Ap(a)p(b)p(c) can 
then be assigned to the interior of Aabc. Note that interior angles are changed after the mapping, 
indicating the quasiconformality of the mapping. 




Surface mesh of a Zebra 
(A) 



Texture map 
(B) 



Texture images 

(Q 



Texture Zebra 
(D) 



Fig. 5.3. Texture images with arbitrary shapes are common in texture mapping techniques. 
With the texture coordinates, texels of the texture can be assigned to the corresponding position in 
the mesh. (A) Mesh of Zebra. (B)The texture maps of Zebra. (C)The texture images of all parts of 
Zebra. (D) Texture mapping result of Zebra. 1 



of M . This significantly reduces the storage requirement for the texture mappings. 
Note that in the case the texture image is of regular shape (e.g. 2D rectangle), storing 
the texture coordinates of the boundary vertices is not necessary. Instead, texture 
coordinates of 4 boundary vertices are sufficient. 

The decoding algorithm is also straightforward. Given the Fourier coefficients 
dj k and the texture coordinates of the boundary vertices. Our goal is to reconstruct 
the texture mapping pi. Using the inverse Fast Fourier transform applied to Fourier 
coefficients c l - k saved, the Beltrami representation : Mi — ^ C can be restored. With 
the Beltrami representation, the texture mapping pi can be reconstructed using the 
Linear Beltrami Solver in Algorithm 4.2. More specifically, pi can be computed by 
solving the linear systems 4.13| and |4.14| , subject to the boundary condition given by 
the texture coordinates of the boundary vertices. Texture coordinates of Mi can then 
be obtained. 



Figure 5.4 and 5.5 give a simple illustrations of the idea. Figure 5.4 ^A) show 
the surface mesh of a human face. Its texture mapping and texture image are shown 
in (B). Note that there is only one texture mapping in this case and that the tex- 
ture image is of regular shape. The original textured surface is shown in (C). The 
proposed compression algorithm is applied, and the reconstructed textured surface 
after compression is shown in (D). Note that the compressed textured surface closely 
resembles to the original textured surface. Figure |5.5[ A) shows the surface mesh of 



1. The texture mapping example is freely available on http://www.kunzhou.net/tex-models.htm 
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Mesh of a human face Texture map and texture image Original textured surface Compressed textured surface 

(A) (B) (C) (D) 

Fig. 5.4. Illustration of the proposed compression scheme. No visible difference can be found 
after the reconstruction. (A) Original mesh of a man face. (B)The corresponding texture map and 
the texture. (C)The original texture mapping result of the man face. (D)The compressed texture 
mapping result of the man face. 






Bimba surface mesh 
(A) 



Texture maps 
(B) 



Original textured surface 
(C) 



Textured surface with compression 
(1% of Fourier coefficients) 
(D) 



Fig. 5.5. Illustration of the proposed compression scheme. The Bimba is first partitioned into 
four parts. Texture maps are then defined independently. (A) Mesh of the Bimba. (B)The texture 
map overlapped with the texture for part- 1,2, 3 and 4 of the Bimba. (C) The un-compressed texture 
mapping result. (D)The compressed texture mapping result. 



the bimba surface. Its texture mappings and texture images are as shown in (B). 
There are totally four texture mappings and texture images with regular shapes. The 
original textured surface is as shown in (C). We apply the proposed compression al- 
gorithm to this example. The reconstructed textured surface after the compression is 
as shown in (D). In both example, only 1% of Fourier coefficients are saved. Again, 
the reconstructed textured surface closely resembles to the original one. 

Figure 5.6 shows a more complicated example whose texture image is of irregular 
shape, which is common in real situation. (A) shows one part of the Buddha surface 
mesh. It is being mapped to a texture image of irregular shape. The texture mapping 
is shown in (B). The compressed texture mapping using our proposed algorithm is 
shown in (C). (D) shows the original textured surface. (E) shows the textured surfaces 
reconstructed from the compressed texture mapping in (C). Note that there is no 
visual difference between the compressed textured surface and the original textured 
surface. 

Note that compression of texture mappings with their coordinate functions gen- 
erally does not work. Figure 5.7 ^A) shows the orginal textured buddha surface. (B) 
shows the compressed textured surface using the Fourier compression of the Beltrami 
representation. The reconstructed textured surface closely resemble to the original 
one. (C) shows the compressed texture surface using the Fourier compression of the 
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Original Compressed 
textured surface textured surface 

(D) (E) 



Fig. 5.6. Texture map compression for one part of Buddha. (A) shows the mesh of Buddha part 
1. (B) shows the original texture map of part 1. (C) shows the compressed texture map of part 1 
encoded by algorithm 5.1. (D) and (E) show the original textured surface and the one reconstructed 
from the compressed texture map in (C). 2 

coordinate functions, with the same compression ratio as in (B). Distortion of the 
texture can clearly be observed. 

Summary of the encoding and the decoding part of our proposed compression scheme 
are described as follow: 

Algorithm 5.1 : ( Encoding of the texture coordinates ) 
Input : Surface mesh: M; Texture coordinate function f : M —> [0, 1] x [0, 1] 
Output : Fourier coefficients cj^ in the truncated Fourier series; Coordinates of the 
boundary vertices ofT. 

1. Obtain the harmonic parametrization, <p : M — ^ D, by solving Equation \4-2\ 

2. Compute the Beltrami representation jif of f using Algorithm 4.1 

3. Compress the Beltrami representation jif using Algorithm 4-3 

4. Store the Fourier coefficients Cj^ in the truncated Fourier series and coordi- 
nates of the boundary vertices ofT. 

Algorithm 5.2 : (Decoding of the texture coordinates) 

Input : Surface mesh M; Fourier coefficients Cj^ of the Beltrami representation; 
Coordinates of the boundary vertices 

Output : Reconstructed texture coordinates of the surface mesh M . 



2. The texture mapping example is freely available on http://www.kunzhou.net/tex-models.htm 
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Original Texture map Compression of Beltrami Compression of 

,^ representation coordinate function 

( } (B) (C) 



Fig. 5.7. Comparison between the results of compressing Beltrami representation and the co- 
ordinate function. (A) shows the original textured Buddha surface. (B) shows the Beltrami repre- 
sentation compression result. (C) shows the coordinate function compression result. 



Table 5.1 
Root mean square error 





Vertices 


Faces 


RMSE(1 


%) 


CF(1%) 


RMSE(3%) 


CF(3%) 


Susan 


5161 


9999 


5.103e" 


-4 


12.29:1 


2.304e- 4 


8.32:1 


Buddha- 1 


6523 


12779 


3.009e- 


-3 


16.64:1 


1.731e- 3 


10.07:1 


Buddha-2 


1921 


3609 


4.298e- 


3 


7.19:1 


2.418e- 3 


5.67 


1 


Buddha-3 


2385 


4563 


3.551e- 


3 


9.54:1 


1.870e- 3 


6.99 


1 


Buddha-4 


2001 


3842 


2.194e- 


3 


10.21:1 


1.021e- 3 


7.33 


1 


Buddha-5 


1985 


3808 


2.766e- 


-3 


10.03:1 


1.551e- 3 


7.24 


1 


Zebra- 1 


7638 


14683 


7.042- 


3 


10.36:1 


4.898e- 3 


7.41 


1 


Zebra-2 


1045 


1924 


3.217e- 


3 


5.71:1 


2.030e- 3 


4.73 


1 


Zebra-3 


1287 


2375 


3.914e- 


3 


5.85:1 


2.311e- 3 


4.80 


1 


Zebra-4 


7600 


14622 


7.576e- 


3 


10.53:1 


4.801e- 3 


7.50 


1 


Zebra-5 


767 


1414 


1.395e~ 


-3 


5.82:1 


1.116e- 3 


4.79 


1 



1. Apply inverse fast Fourier transform on cj^ to restore the Beltrami represen- 
tation fi f defined on triangular faces of M 

2. Parametrize the surface mesh M by the harmonic mapping <\> to the unit 
square through solving Equation \4.2\ 

3. Reconstruct the texture coordinates by using the Linear Beltrami solver 



(Equation 4.13 and 4.14) subject to the boundary condition given by the 
texture coordinates of the boundary vertices. 

Quantitative experiments have been carried out to demonstrate the performance 
of our proposed algorithm. Experiments are performed on three surface meshes, 



namely, 'Susan', 'Buddha' and 'Zebra' (See Figure 5.9). 'Susan' is a simply-connected 
open surface with 5161 vertices. 'Buddha' and 'Zebra' are genus-0 closed surface 
with 15138 vertices and 20157 vertices respectively, which are partitioned into sev- 
eral simply-connected open surfaces. Since some partitions in 'Buddha' and 'Zebra' 
contain very few vertices, we applied the compression algorithm only on major parts 
with more vertices. We tested the proposed algorithm with 1% and 3% of the Fourier 
coefficients (FC). 



To measure the accuracy of the compression scheme, we compute the root mean 
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Fig. 5.8. Statistics of the displacement error of each vertices. (A)Buddha part-1. (B)Zebra 
part-1. (C)Zebra part-4- (D)Susan. The majority of the reconstructed texture coordinates has less 
than 1 relative percentage error. 

Table 5.2 

Summary of the texture mapping compression result. 





Susan 


Buddha 


Zebra 


Number of vertices 


5161 


15138 


20157 


RMSE 


5.103e- 4 


1.974e- 3 


6.44e~ 3 


Compression ratio 


12.29:1 


17.27:1 


13.68:1 


Data saving 


91.86% 


94.21% 


92.69% 


Memory required 


1.6406 kB 


3.3691 kB 


5.6289 kB 


Original memory required 


20.1548 kB 


58.1883 kB 


77.0027 kB 



square error (RMSE), defined by 



RMSE = 



\ 



i ™ 

-Eii/^)-/^!, 



(5.2) 



where n stands for the number of vertices, / and / are the original and the re- 
constructed texture map respectively. We also compute the compression ratio (CR) to 
quantify the compression efficiency of the algorithm. The compression results for each 
partition of the surface meshes are shown in Table 5.1 Results shows that the re- 



constructed textured surface after compression is very close to the original data, with 



Beltrami representation and applications 



21 





(A) Original textured human face (B) Original textured buddha (C) Original texured zebra 




(D) Compressed textured human face (E) Compressed textured buddha (F) Compressed textured zebra 

Fig. 5.9. Summary of compression results of Susan, Buddha and Zebra. The upper row shows 
the uncompressed textured surfaces with their corresponding texture maps and the texture images: 
(A)Susan (B)Buddha (C)Zebra. The lower row presents the compression results using 1% Fourier 
coefficients: (D) Susan. (E) Buddha. (F) Zebra. 



very small RMSE. Even in the case when only 1% of Fourier coefficients are saved, 
the RMSE still remains in the order of 10 -3 . As expected, the RMSE is smaller 
when 3% of Fourier coefficients are saved (see column 5). The compression ratios are 
shown in column 4 and 6, which illustrate our proposed algorithm can significantly 
reduce the storage memory for texture mappings. Note also that the table shows 
the out-performance of CR in 'Buddha-1', 'Zebra-1', 'Zebra-4' and 'Susan'. This is 
expected as texture coordinates of the boundary vertices contribute a relatively small 
amount of total storage of the fine meshes. Hence, our compression algorithm, which 
compresses the texture coordinates in the interior, gives better compression results. 



Figure |5.8| presents the displacement error of the each reconstructed texture coor- 
dinates measured in the supreme-norm. It is observed that majority of the texture 
coordinates can be reconstructed almost losslessly. 

In Table |5.2[ we study the compression performance of the whole mesh for the 
three surfaces. For each surface, 1% of Fourier coefficients are stored. The average 
RMSE is computed which is defined as: 

p 

RMSE avg = ^RMSE(k), (5.3) 
k=i 



where P is the number of parts in surface mesh, N is the total number of vertices, rik 
stands for the number of vertices in part k of the partitioned mesh and RMSE(k) is 
the corresponding RMSE calculated by formula |5.2| Note that the average RMSE 
is small in all 3 cases. Therefore, there is no noticeable difference between the com- 
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Fig. 5.10. A close look to Zebra part-1. (A) Uncompressed Texture mapping. (B) Compressed 
texture mapping with 4.9 x 10~ 3 RMSE. 



pressed textured surface and the original one. 

The actual storage memories needed are also listed. Note that after the com- 
pression, the storage memories of the texture surfaces are much less than that of the 
original data. The compression ratios are at least 12:1. This demonstrates the efficacy 
of our proposed method. 

Finally, every smooth Beltrami coefficient corresponds to a smooth bijective quasi- 
conformal map. As a result, no abnormal texture (e.g. zaggy textures) would appear 
on the textured mesh. The diffeomorphic property is also a major reason why there is 
no noticeable difference between the original and the reconstructed texture mapping 
even with higher RMSE (See Figure (ITTo ) . 



5.2. Video Compression. With the recent development of video compression 
techniques, real time digital television and Internet streaming video become practi- 
cal. However, resolution of the video is limited by the channel bandwidth. Video 
compression is therefore an important field of research. 

Different video compression algorithms have been proposed [42 , 44, 43 . The basic 
idea of these algorithms is to remove temporal and spatial redundancies existing in 



a video sequence. For instance, the two images shown in Figure 5.11 'A) and (B) are 
the 1 st and the 31 st frame of a video respectively. (C) shows the intensity difference 
between (A) and (B). The black regions correspond to the unchanged background. 
The unchanged background is an example of the temporary redundant information 
existing in the uncompressed video. In motion compensation techniques, instead of 
storing every image frames in the video, I- frame, P-frame and B-frame are intro- 
duced. Commonly, video frames are partitioned into frame sets called the Group of 
Picture(GOP): 

I1B1B2 P\ Bs B4 P2 B$ Bq P3 Bj BgP^BgBio 

I- frame is the reference frame, which is stored in the compressed image form. P- 
frame is called the predictive frame. It is encoded as a motion vector field (MV field) 
together with a residual. The MV field creates a prediction depicting how pixels in 
previous frame move. This prediction is then subtracted from the original frame to 
obtain the residual image. If the prediction is successful, the residual image can be 
represented with fewer bits than that of the original frame. B-frame is called the 
bi-directional predictive frame. It is encoded as the residual of the predicted image, 
which is obtained from the interpolated MV fields from previous and future frames. 

On average, P-frames contributes 50% less storage than that of I-frames. However, 
the required storage memory for the MV field is still significant when considering HD 
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(A) (B) (C) 

Fig. 5.11. Illustration of the redundant information appears in a video. (A) The 1 st frame (B) 
The 31 st frame. Area in the boxes are examples of duplicated information appear in the video. (C) 
The intensity difference between (A) and (B). 



videos. For example, if a maximum of 4x4 block mode is used in a full HD [1920 x 1280] 
video, each P-frame requires 2.765 x 10 6 bits of memory to store the MV field. It thus 
calls for the need of compressing the MV field. 

Suppose Fi and F 2 are two image frames in a video sequence. The MV field 
V : Fi — > R 2 is a vector field defined on F\ . It describes how pixels in F\ should move 
to get the estimation of the image frame F 2 . In particular, the MV field V can be 
considered as a mapping T : F\ — >• F 2 between F\ and F 2 given by: 



T(x,y) = (x,y) + V(x,y) (5.4) 

By introducing a Delaunay triangulation to Fi, T can be viewed as a piecewise 
linear homeomorphism between triangular meshes. Hence, every MV field V can 
be represented by the Beltrami representation \it of T. Note that the harmonic 
parameterization of the meshes are not required in this case, since the triangular 
mesh is already a 2D rectangle embedded in R 2 . Using Algorithm 4.3, the MV field V 
can be compressed by performing the Fourier compression of \it- Storing the Fourier 
coefficients of the truncated Fourier series of ht requires much less storage memories 
than that of the MV field itself. 

The reconstruction of the MV field from the Fourier coefficients Cj^ is straight- 
forward. Following the idea of Section 4.3, we first carry out the inverse fast Fourier 
transform to restore the Beltrami coefficient \±t- Using the Linear Beltrami solver 
as described in Algorithm 4.2, T and hence the corresponding MV field V can be 
reconstructed efficiently and accurately. 

The encoding and decoding of the compression algorithm can be summarized as fol- 
lows. 

Algorithm 5.3 : (Encoding of the P-frame) 
Input : Frame F\ (Reference) and F 2 (P-frame) 
Output : Coefficients c^h in the truncated Fourier series 

1. Obtain the motion vector field in regular grid 

2. Compute the Beltrami representation by Algorithm J^.l 

3. Use Algorithm 4-3 to compress the Beltrami representation ft and store the 
coefficients Cj^ in the truncated Fourier series. 

Algorithm 5.4 : (Decoding of the P-frame) 

Input : Frame F\; Coefficients Cj y k in the truncated Fourier series 
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Fig. 5.12. Comparison between the uncompressed and the compressed video using 0.5% of 
Fourier coefficients: (A)Flower 1. (B)Flower 2. (C)Heart 1. (D)Heart 2. Upper rows are some 
original 4 th P-frames in each frame set. The lower rows show the corresponding compressed P- 
frames. 3 
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Fig. 5.14. PSNR between each uncompressed and compressed P-frames. (A)Flower 1. 
(B) Flower 2. (C) Heart 1. (D) Heart 2. 



Output : Motion vector field V 

1. Apply inverse fast Fourier transform to restore the Beltrami coefficient \i 

2. Perform Linear Beltrami solver as described in Algorithm 4-2 to obtain (x, y) 

3. Compute V by V(x, y) = (x, y) — (x, y) 

To study the performance of our proposed algorithm, experiments have been 
carried out on real videos. In our experiments, all B-frames in the GOP are taken 
away for simplicity. Instead, we consider the following frame set: 

I1P1P2P3P4 

MV fields in each P-frames are obtained from the previous I- frame or P-frame, which 
are then compressed by our proposed algorithm. In order to study the performance 
of our algorithm without adding any residual, per-pixel MV field is used. It should 
be noted that the proposed algorithm can also be applied to block-based MV fields in 
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Fig. 5.15. A closer look to the plots in Figure {5. 1J\ Patterns of decreasing PSNR with a period 
of four frames can be observed. This is the consequence of the accumulation of errors from previous 
P- frame reconstruction. ( A) Flower 1. (B)Flower2. (C) Heart 1. (D)Heart2. 



exactly the same way. However, residual has to be added. In the decoding process, 
errors may be introduced to the MV fields after the compression. As a result, the 
reconstructed P-frame Pi might not be identical to the original frame P^. Meanwhile, 
the decoding of P^ + i is based on the reconstructed P-frame Pi rather than the original 
Pi. The reconstruction error would be accumulated. However, experimental results 
show that the accumulated errors are small that the effect to the overall results would 
be negligible. 

Experiments have been carried out on four video clips, namely 'Flower 1', 'Flower 
2', 'Heart V and 'Heart 2'. Their resolutions are [360x262], [512x384], [600x480] and 
[1280 x 720] respectively. Different percentages of Fourier coefficients have been used. 
Figure |5.12| shows some original P-frames of the 4 videos and their corresponding 
compressed P-frames using our proposed algorithm. Here, 0.5% of Fourier coefficients 
are used. As shown in the figure, no visible differences can be observed after com- 
pression. It means, it demonstrates the effectiveness and accuracy of our proposed 
algorithm in compressing MV field. 

We also examine the performance of our algorithm quantitatively. Figure 5.14 
shows the the peak signal-to-noise ratio (PSNR) between the reconstructed P-frames 
and the original P-frames. The PSNR is defined by 



PSNR= 10 log 



10 



255 2 iVM 

Vmse ' 



with 



M N 



(5.5) 



(5.6) 



=i j=i 



where the size of the frames is M x N. As shown in Figure 



5.13 



A), the average PSNR 
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in all four cases are higher than 90 when 0.5% Fourier coefficients are captured. In 
other words, only a negligible increase in residual will be induced by the error of the 
reconstructed MV field. As a result, the required storage memory for the residual 
image will not be much affected after compression with our algorithm. 

Figure 5.13[ B) presents the corresponding compression ratio for different percent- 
age of Fourier coefficients stored. When 0.5% coefficients are saved, compression ratio 
of the MV field can be as high as 56 : 1. The high compression ratio of the MV 
field can effectively improve the compression ratio of the existing video compression 
algorithm such has MPEG and H.264. After the compression, the storage memory 
of the MV field is almost negligible compare with the total file size. For example, 
suppose the MV fields contribute 1/3 total storage of the compressed video. Using 
our algorithm to compress the MV field, the storage requirement of the compressed 
video can be reduced by around 32%. 

Figure 5.14 shows the PSNR between each pair of the compressed and original 
P-frame. It is observed that PSNR stays close to about 90. It means the compressed 
P-frames closely resemble to the original ones. Figure 5.15 shows the zoom-in of the 
plots in Figure [57T4 Decreases in the PSNR can be observed in each frame set. This 
is expected since the errors in MV fields are accumulated in each cycle. However, the 
decreases are very small. It means the effect of the accumulated errors in the MV 
fields to the overall result is negligible. 



6. Conclusion. We address the problem of compressing surface homeomor- 
phisms, which has important applications in computer graphics and imaging. Surface 
homeomorphisms are usually represented and stored by their 3D coordinate functions. 
It often requires lots of storage memory, which causes inconvenience in data trans- 
mission and data storage. In this paper, we propose an effective algorithm for com- 
pressing piecewise linear bijective surface maps between meshes using their Beltrami 
representations. The Beltrami representation is a complex-valued function defined on 
triangular faces of the surface mesh with supreme norm strictly less than 1. Under 
suitable normalization, there is a 1-1 correspondence between the set of surface homeo- 
morphisms and the set of Beltrami representations. Given a Beltrami representation, 
the associated bijective surface map can be exactly reconstructed using the Linear 
Beltrami Solver introduced in this paper. Since the Beltrami representation has very 
few constraints, it can be easily combined with the Fourier approximation to compress 
bijective surface map without distorting the bijectivity of the map. This significantly 
reduces the storage requirement for surface maps. In this paper, we proposed to 
apply the algorithm to texture map compression and video compression. With our 
algorithm, the storage requirement for textured surfaces can be significantly reduced, 
while well preserving the quality of the original data. Our algorithm can also be ap- 
plied to compressing motion vector fields for video compression. After compressing 
the motion vector field, the compression ratio of the state-of-the-art video compres- 
sion algorithms can be significantly improved. Experiments on real textured surfaces 
and videos demonstrate the effectiveness and efficacy of our proposed algorithms. 
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